Global visualization process (GVP) and system for implementing a GVP

ABSTRACT

A system and process that incorporates hardware and software as elements to be combined with procedures and processes to obtain, format, store, combine, control, display, record, and visualize dynamic scenarios by interacting with accurate, realistic models and actual events within, on, and above a three-dimensional surface to be observed or modeled. One application provides a user-manipulated large-scale dynamic display of systems testing in a real world environment for real time visualization by test personnel. The Global Visualization Process (GVP) system is an integrated software solution for high-performance visualization. GVP software and process is capable of displaying extremely high resolution terrain models and imagery in real time over the entire surface of the planet, as well as a large number of moving entities and their associated graphical models. The system can display imagery at 2 cm/pixel, and infinitely detailed terrain in real time over the whole surface of a planet. All displayed data is referenced to the World Geodetic System 1984 (WGS-84) ellipsoid for true round-earth effects, and can be rendered in correct asymmetric stereo. These features, combined with a network application progamming interface (API), make GVP suitable for flight simulation out-the-window displays, command and control scenarios, and mission review or rehearsal.

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT

[0001] The invention described herein may be manufactured and used by orfor the government of the United States of America for governmentalpurposes without the payment of any royalties thereon or therefor.

BACKGROUND

[0002] 1. Field of the Invention

[0003] The present invention pertains to optimum visualization ofcomplex scenarios, in particular, a large-scale display, withuser-adjustable resolution and viewpoints, of these scenarios as eventsoccur in real time over a wide geographic area. The Global VisualizationProcess (GVP) system is an integrated software solution forhigh-performance visualization. GVP software is capable of displayingextremely high resolution terrain models and imagery in real time overthe entire surface of the planet, as well as a large number of movingentities and their associated graphical models.

[0004] 2. Description of the Related Art

[0005] Flight simulation has proved to be an effective method for crewand mission training. An integral component of flight simulation is theout-of-the-window visual scene. The creation of a GVP visualization orvisual database for flight simulation (or for mission planning andrehearsal or for other applications such as command and control displaysystems) typically begins with real-world source data that has beenderived from satellite imagery, overhead photography, U.S. GeologicalSurvey information or mapping source materials. The conventionalapproach until very recently (now still employed in order to comply withlimited computer resources) has been to construct a visual environmentfrom representative artificial models and modeled elements to meetspecific training objectives.

[0006] While a graphics arts constructed visual database system may bevery effective for a particular training application, it should also beappreciated that there are many diverse situations where a fullyrepresentative visualization system which renders real-world data,unlimited in resolution, scale, and represented area, would bedesirable. GVP offers a general-purpose visualization system that doesnot need to be redesigned for each new project or set of trainingexercise.

[0007] The Global Visualization Process (GVP) of the present inventionaccomplishes what conventional methods and systems can not. In thecontext of an integrated system having complementary components forlarge-scale real time visualization, GVP can display large-scale terrainmodeling and simulation depictions, in user selectable resolution,without the numerous drawbacks of conventional systems. Conventionalsystems suffer from some or all of the following limitations:

[0008] Highly specific processes and model data formats limit the rangeof data inputs to a small subset of available information.

[0009] Video outputs are limited to specific display devices or types.

[0010] Stereoscopic viewing is not supported or is not controllable.

[0011] Overall size of operating terrain models is restricted to smallareas and the greater the detail (resolution), the smaller the areadisplayed.

[0012] When put in motion, as in flight simulation or when the depictioneyepoint is moved, model depiction has unacceptably low update rates.

[0013] Small numbers of fixed or mobile objects added to the terrainmodel grossly and unacceptably inhibit the video update rate.

[0014] Model construction and image computation based on fundamentalflat-earth geometry introduces gross positional errors with complexvariations in magnitude. These errors confound operations whenindependent systems interact.

[0015] Without major revisions to adapt to multi-processor andmulti-pipe computer systems, existing software architecture does notfully exploit state-of-the-art graphics-oriented computers.

[0016] Conventional systems cannot employ imagery and terrain geometryof mixed resolution, or can do so only with difficulty.

[0017] Accordingly, there is a need for a system and process forproducing visual databases that preserve the accuracy of the input databy eliminating flat-earth geometry distortions, and with greatimprovements in speed, area, resolution, and video display output. AsGVP was being developed to meet this need, its specialized propertieswere determined to provide solutions to many more applications.

SUMMARY OF THE INVENTION

[0018] The Global Visualization Process (GVP) system is an integratedsoftware solution for high-performance visualization. GVP software iscapable of displaying extremely high resolution terrain models andimagery in real time over the entire surface of the planet, as well as alarge number of moving entities and their associated graphical models.The system can display imagery at 2 cm/pixel, and infinitely detailedterrain in real time over the whole surface of the planet earth. Alldisplayed data is referenced to the World Geodetic System 1984 (WGS-84)ellipsoid for true round-earth effects, and can be rendered in correctasymmetric stereo. These features, combined with a network applicationprogamming interface (API), make GVP suitable for flight simulationout-the-window displays, command and control scenarios, and missionreview or rehearsal.

[0019] The Global Visualization Process (GVP) enables accurate and rapidvisualization of a wide area that may include ongoing complex militarymaneuvers comprising extensive spatial and temporal gradients. GVPcombines actual imagery, geometric relationships and stored map data,with location and activity information for both mobile and fixed objectsto generate and control display of large-scale visual depictions(visualizations). GVP integrates data using full external networkconnectivity for both simulations and actual operations.

[0020] Applications include human visualization for command and controlof military operations, tests, training, reconnaissance andsurveillance, simulations, mission rehearsal, war games and syntheticvision systems. GVP produces high quality displays having dynamic andperceptual properties matched to user needs while providing immediateuse of acquired data. GVP can be adapted for use by a single person,such as a virtual image display, or large group displays, such astheaters. GVP may provide standard two-dimensional outputs orstereoscopic depictions thus matching a user's perceptual requirementsfor complex events and spatial interactions, such as may occur in wargames.

[0021] A preferred embodiment of the present invention provides a systemand process that incorporates hardware and software as elements to becombined with procedures and processes to obtain, format, store,combine, control, display, record, visualize and interact with accurate,realistic models and events within, on, above and below athree-dimensional surface to be observed or modeled.

[0022] A preferred embodiment of the present invention discloses aprocess for dynamic human visualization of events occurring within avolume having varying spatial and temporal gradients, which providesreadily adjustable scale and resolution, and initiating activitiesinternal thereto. A preferred embodiment of the process comprises: 1)acquiring data that represents imagery, geometric and time relationshipsto be used for generating motion paths, stored maps, location, andactivity, and the data is acquired from standard sources. 2) integratingthe data using full external network connectivity. The data is acquiredfrom simulations, actual events or standard sources and the dataincludes multi-source satellite and aerial imagery available in variouswavelengths and formats. 3) developing at least one database, having asoftware architecture from which at least one model is generated. 4)generating at least one display containing at least one depiction fromsaid at least one model and said data, wherein said depiction may bedisplayed in real time. 5) controlling said at least one display.

[0023] A preferred embodiment of the present invention discloses asystem, having inputs, and outputs, that enables a process for dynamichuman visualization of a volume, including events having varying spatialand temporal gradients that are occurring within the volume. The systemprovides readily adjustable scale and resolution and initiatingactivities internal thereto. The system comprises: 1) at least one datagenerator as at least one source of data. The data represents imagery,geometric and time relationships to be used for generating motion paths,stored maps, location, and activity and the data is acquired fromstandard sources. 2) memory for storing and accessing at least a portionof the data. 3) at least one interface for communication between thesystem and external devices. 4) at least one visualization device,having inputs and outputs, for displaying at least one depiction. Thedepiction may be derived at least in part from a model, having at leastone input and at least one output, and is displayed in real time. 5) atleast one record and playback device for provision of at least someinputs to the visualization device. 6) software for manipulating theprocess. The software is used to generate at least one database and thesoftware is used at least in part to create at least one model from thedatabase. Also, the software is used to control the inputs to and theoutputs from at least one model for inputs to at least one display andthe software is used to control the outputs from the record and playbackdevice and the interface. 7) at least one controller for controllingsaid inputs and outputs to the system. In a more preferred embodiment,the data generator comprises at least one device such as a real timedata collection system, a GCCS system, a scenario generator, a devicesimulator or a cockpit simulator.

[0024] A preferred embodiment of the system and process includes usingquad tree architecture for terrain geometry files and clip textureimagery, a Master Object Manager to separate objects, and a geographicalcoordinate system, such as WGS-84, to convert the imagery into oneglobal model.

[0025] Using the quad tree architecture allows management of bothposition and resolution variations within the clip texture files and theterrain geometry files and facilitates the population of at least oneworldwide database. The resolution of the display can be adjusted forvarying eyepoints with a first adjustment possibly defining a firstlevel of a plurality of levels within the quad tree architecture. Eachsucceeding level of the plurality of levels consists of four sub-sectorseach depicting a quarter of the area of the depiction of an immediatelypreceding level but containing the same amount of image data as thedepiction of the immediately preceding level, thus providing higherresolution than any of the preceding levels. Further, moving through theplurality of levels, in either direction, provides a resolution requiredby a user.

[0026] The Master Object Manager module having software architecture,interfaces to outside events and collects communication and controlprocesses. The Master Object Manager can interact with standards-basedprocesses such as distributed interactive simulation (DIS), Departmentof Defense (DoD) systems under High Level Architecture (HLA), DefenseInformation Infrastructure Common Operating Environment (DII-COE)formats for the Global Command and Control System (GCCS), and commercialcomputer network communications protocols. The software architecture ofGVP with the Master Object Manager achieves update rates facilitatingreal time viewing on the display and permits a user's areas of interestto be embedded at a pre-selected resolution. The system accepts data informats such as DII-COE messages in GCCS-M, Combat Command and ControlSystem, HLA, DIS, military LINK, and air traffic control radar or anycombination thereof.

[0027] Accurate and rapid visualization of an area via orientingposition is based on the WGS-84 geophysical standard for world shape toat least one eyepoint. The WGS-84 geophysical standard is fullycompatible with standard navigation systems and included within thedesired area are events having a range of spatial and temporalgradients. Also, systems operating to the WGS-84 permit navigationsystems to connect, register, and synchronize within the process. As aresult, the accuracy of the data received by the system is preserved.

[0028] Initially GVP addressed the need to depict complex militaryflight test operations. For planning, controlling, and assessment, theneed for rapid clear communication between all concerned could be metonly by some method of advanced visualization. Thus, GVP addresses thefollowing needs:

[0029] Accepts data inputs or source material from a large variety ofavailable information for terrain model construction. This includes mapdata, image data and terrain shape data.

[0030] Provides a range of data inputs suitable for a large variety ofavailable information.

[0031] Provides for video outputs to a variety of display devices.

[0032] Provides for stereoscopic viewing.

[0033] Provides for operating terrain models of large areas at suitableresolution for human interpretation.

[0034] Provides for ready updating of dynamic model depiction,particularly useful in flight simulations or when the eyepoint ischanged.

[0035] Provides a usable video update rate even when large numbers ofobjects are added.

[0036] Calculations and model construction are based on round-earthgeometry, eliminating positional errors.

[0037] Software architecture fully exploits state-of-the-artgraphics-oriented computers.

[0038] Readily employs imagery and terrain geometry of mixed resolution.

[0039] Advantages of preferred embodiments of the present invention, ascompared to conventional systems, include permitting:

[0040] accurate and rapid visualization of a wide area;

[0041] visual capture of activity involving extensive spatial andtemporal gradients;

[0042] merging of actual imagery, geometric relationships and stored mapdata, with location and activity information;

[0043] generation and control of the display of large-scalevisualizations;

[0044] integration of data using full external network connectivity;

[0045] production of displays meeting a user's dynamic and perceptualrequirements;

[0046] immediate use of acquired data;

[0047] adaptation for use by a single person or a large group;

[0048] standard two-dimensional outputs or fully stereoscopicdepictions;

[0049] support for both simulations and actual operations in real time;

[0050] simplified design of alternate configurations;

[0051] improved robustness;

[0052] increased flexibility; and

[0053] ready upgradability.

[0054] Embodiments of the present invention can be applied to depict anyactivity requiring a decision maker to undertake one or more of thefollowing actions: plan, coordinate, control, communicate, command,assess, reconnoiter, negotiate, direct, collate, organize, or terminateactivities, or any action related to any of the above, either before orafter in time. Sample activities include military flight testoperations, training, simulations, tests, computer modeling, war games,maneuvers, combat operations, flight guidance or vehicle guidance anddomestic disturbances. The realistic training available with the systemsaves capital equipment, as well as training and maintenance costs,while providing a better-trained individual. It will also providetop-level decision makers with very realistic “hands-on” experiencewithout the expense of participating in an event that could cost livesand material.

[0055] Preferred embodiments are fully disclosed below, albeit withoutplacing limitations thereon.

BRIEF DESCRIPTION OF DRAWINGS

[0056]FIG. 1 depicts an overall flow chart depicting functions performedin a preferred embodiment of the present invention.

[0057]FIG. 2 is a diagrammatic perspective view showing a “tree” datastructure relationship between grid quadrangles at different grid levelsfor shifting or scrolling between grid quadrangles at the same gridlevel and “zoom in” and “zoom out” between grid quadrangles at differentlevels.

DETAILED DESCRIPTION

[0058] A preferred embodiment of the present invention, the system 100of FIG. 1, incorporates hardware and software as elements to be combinedwith procedures and processes to obtain, format, store, combine,control, display, record, visualize and interact with accurate,realistic terrain models and events or activities in, on, above andbelow the terrain. Elements of the developmental system include severalcommercial computer and display products of advanced but conventionaldesign. The GVP software runs on standard computers, including bothgraphics processing computers and personal computers. Some of thesoftware employs commercially available programs and interfaces withcommercially available programs.

[0059] Again referring to FIG. 1, User Interfaces 101 permit softwaremanipulation of databases, storage, interface to internal sources and anexternal interface module (Master Object Manager 103), replay, and adisplay through CTL World software 102, interface to sources external tothe process and internal functions via a software module, Master ObjectManager 103, and user input and control through a variety ofelectro-mechanical control devices 104, such as a keyboard, mouse, orjoystick.

[0060] A database generation process 105, functions (off-line) to makevisual database file structures which populate a visual database 106,that may be manipulated by CTL World software 102, to provide displays107 in multiple windows in either two or three dimensions and which mayalso be input directly to displays in cockpit simulations 108. TheMaster Object Manager 103, provides interface to external sources,either simulations using DIS or a HLA or actual scenarios using GCCS103B, for example. Simulation scenarios may be provided by a scenariogenerator 109, that may include inputs from conventional modeling andsimulation programs such as FORCES 109A (Force Operational ReadinessCombat Effectiveness Simulation), ModSaF 109B (Modern Semi-automatedForces), or EADSIM 109C (Extended Air Defense Simulation), or actual orsimulated events using a GCCS system 110, including its Repeat (datarecord and replay) mode 110A. A history of object positioning, eyepointand events is maintained as a Track History 111, in turn provided to areplay system, GVP Playback Controller 112, for manipulation by CTLWorld software 102 in developing depictions for display on amulti-window display 107 or for use by the Master Object Manager 103including for use as input to cockpit simulations 108.

[0061] GVP incorporates specialized processes to develop terrain models,termed database generation 105. Standard commercial database generationsupport software including TERREX™, ERDAS IMAGINE®, MULTIGEN®, and SGI®elements are employed in specialized or customized ways along withcustomized or original CTL software and procedures to turn terrainimagery and elevation data files into GVP terrain model databaseproducts, i.e., a visual database 106. The specialized file and worldgeometry of GVP requires specific and unconventional operations toorganize standard source data 113 in terrain imagery and elevation datato create terrain databases 106. Major parts of the database developmentprocesses run on small single processor or multiprocessor PCs, and canapply to data from all conventional sources, including multi-layer mapmaterial. For example, satellite and aerial imagery from numeroussources, in different wavebands and formats, have been processedsuccessfully. Visual databases 106 for GVP are populated by generatingimagery files, called clip texture files and storing these separatelyfrom terrain geometry files. Terrain geometry, as processed for databaseuse, generates triangulated irregular network (TIN) files. These arepolygons assembled to approximate the surface shape of the terrain.Coordinating the image files, the geometry files, relative informationcontent and sequencing for precision and speed in both the filegeneration processes and in the image generation process is a key strongpoint of the GVP invention. Both types of files have an associatedresolution (provided as data density) indicating the degree of precisionin representing the actual source terrain. An advantage of GVP is thatclip texture files and terrain geometry files are retained and processedseparately, not being combined until late in the “display generation”process, thus saving interim computation steps.

[0062] As illustrated in FIG. 2, GVP applies dual “quad tree”architecture for the clip texture and terrain geometry files. Inactuality, the terrain imagery files comply with the SGI® displaysoftware, PERFORMER™, which employs clip textures in a heirarchicalformat of SGI® design. However, other display control programs capableof generating video views of 3-D modeled objects could be incorporated.For the purposes of this application, it is a quad tree, forming onehalf of the dual quad tree architecture. In a preferred embodiment ofthe present invention, a base terrain skin is generated according to anapproach referred to as the “quad tree” approach. Under the quad-treeapproach, a region of terrain represented by a tile at a coarser levelof detail may be represented at the finer and next level of detail byfour tiles. Furthermore, the scene graph is generated such that when theterrain skin is played back, a tile is never displayed at a level ofdetail that is more than one level different from the level of detail ofany adjacent tile. Finally, the polygons in each tile are generated sothat the shared edges between the tiles appear well matched. Techniquesfor generating a terrain grid according to the quad-tree approach andfor generating grids formed of matched shared edges are well known tothose skilled in the art. Using a dual quad tree approach, that is onefor terrain shape and one for imagery, enables management of bothposition and resolution variations for development of “world-widedatabases”. GVP achieves its high performance in area, resolution,precision and speed by effective innovations, architecture, and balanceddesign in the dual quad tree approach. At the lowest resolution (datadensity) and detail, an entire hemisphere can be depicted in one workingfile level. The resolution of the display 107 can be matched or exceededfor distant eyepoints (not separately shown), e.g., a view that includesan entire hemisphere, by a visualization database 106 with relativelylow resolution, i.e., on the order of 1 or 2 kilometers smallest detailelement. This “zoom out” version comprises the first quad tree level forthe GVP architecture for both clip texture and TIN files. Each level isfurther divided into four sub-sectors depicting one-quarter of the area,but with similar file size and amount of detail data or polygons thusmaking much higher resolution as first “zoom in” version. This structureis repeated as necessary to provide the resolution required by a user,i.e., additional “zoom in” and “zoom out” versions, as illustrated inFIG. 2. Imagery is also processed in stages with increasing resolutionand conforming to the TIN Quad Tree file structure. This forms the basicinformation storage and data manipulation architecture of the GVPsystem.

[0063] A preferred embodiment of the present invention incorporates anarchitecture with 32 levels that can hold and operate anywhere on theearth's surface with a maximum resolution of about two centimeters.Further, the architecture is expandable, as necessary for higherresolutions or other purposes, such as celestial bodies, operations inspace, or even for mapping manmade objects.

[0064] Advantages of GVP include:

[0065] The processes of database implementation tailor multi-source dataand generate quad tree structured terrain models with correspondingimage data files.

[0066] Storage is implemented in a conventional computer hard diskarray.

[0067] Display software, termed “CTL World,” accesses the quad treefiles to page in data at the resolution required to match eyepoint anddisplay considerations, to order the computation of video display imagesand to do everything required to generate completed viewable models. Itincludes stereoscopic display considerations.

[0068] The CTL World display generation process uniquely combinesseveral advances in visualization software, such as:

[0069] Model and computational architecture retains separation of thetexture (or imagery) and geometry files until late in the display runtime, thus truncating much of the preliminary computation prior towindow content selection. This, in turn, permits current computers toproduce fast update rates, above 30 frames per second, suitable fordemanding flight simulation and other applications.

[0070] Improved world reference geometry bases the position orientingprocesses on the WGS-84 Geophysical Standard for world shape, in turnbeing fully compatible with modern navigation systems.

[0071] Models built using GVP retain positional accuracy in the originaldata, in turn, enabling accurate depiction of platform locations andreported events. Models built using GVP retain positional accuracy inthe original data, in turn, permitting effective verification andvalidation operations.

[0072] Terrain and imagery file structure permits multiple resolutionsor detail levels so that areas of interest can have highly detailedcoverage while other areas do not. Selected areas can be revised orupdated independently. Coverage areas and detail levels can be populatedto fit the available storage facilities (disk array resourceallocation), and not be constrained by other computer systemlimitations.

[0073] CTL World software incorporates flexible user interfaceprovisions, various input device drivers for position and motioncontrol, and broadly functional application programmer interface (API)features enabling quick tailoring to new uses.

[0074] Input devices 104 include, for example, multiple controls forvideo signal outputs for display device type and location matchingadjustments, control over the stereoscopic rendering parameters, andinput selection options for motion-position control devices such astwo-axis joystick controls and three-axis (six degree of freedom) helmetmotion trackers.

[0075] Completing the basic GVP architecture is a separate softwaremodule termed the Master Object Manager 103. Master Object Manager 103interfaces the system to outside events of all types and determines theobjects and activities displayed with the terrain model. It permits twoway communication with simulation 108, modeling 109 and operationalevents 110 external to GVP. Network operations currently implemented viaMaster Object Manager 103 interact with standards-based processes fordistributed interactive simulation (DIS), and with the DoD systemsoperating with High Level Architecture (HLA) 103A. For interaction withoperational forces 110 the interface employs Defense InformationInfrastructure Common Operating Environment (DII-COE) formats (notseparately shown) for the Global Command and Control System (GCCS) 103B.In these formats, and generally compatible with computer networkcommunication protocols, Master Object Manager 103 assembles and trackslocations, orientation, types, activities, and depiction-relevantfactors for fixed and mobile objects of all types. Within the MasterObject Manager 103, various sorting, filtering and aggregationalgorithms refine an “object list” (not separately shown) for thedisplay system 107. Some aspects of selection for visibility and displaylevel of detail (LOD) required are conducted inside Master ObjectManager 103 to reduce computational demands in the CTL World displaygenerator 102. This reserves computer resources for the graphicsprocesses CTL World display generator 102 and orders the data trafficbetween the CTL World display generator 102 and processes or systemsoutside GVP including simulations 108, scenario generators 109, andoperational events 110. In addition, Master Object Manager 103 cancommand or “feed” multiple copies of CTL World 102 to match a variety ofextended visualization generation demands and to synchronize multipleremote or nearby visualization processes to a common consolidated dataset.

[0076] Finally, the GVP architecture is completed by two supplementaryelements, a track file recorder 111 to store motion paths as trackhistory of various events for data purposes, and an all purpose eventreplay control utility, shown as GVP Playback Controller 112. Processesexternal to GVP, but to which it is designed to be connected, e.g.,simulators 108, models 109, and operational data or operational datarecorders 110, normally have their own data recording and replaycapability. These two elements of GVP function to replace those separateoperations, combining sources for the display 107 and for activitiesinitiated internal to GVP. For example, the local computer interface toGCCS 110 inputs is itself a computer and has record-playback capability(i.e., “Repeat” 110A). The Repeat capability might suffice, toreconstitute and replay or manipulate visualizations accomplished withthe GVP system alone, but if the visualization involves other datasources as well as GCCS 110 events, this would not be practical. Thus,GVP uses its track history 111 and GVP Replay Controller 112 toreconstruct and manipulate visualizations.

[0077] In sum, in an embodiment for use by government users, GVPincorporates a suite of government owned products and software processesthat are suitable for use in a variety of applications, e.g., militaryscenario depiction and visualization. The specialized architecture ofGVP allows creation of operating models that are geo-specific,geo-referenced and universally scalable. The results are accuratedepictions of a round world. The GVP products support immediate directapplication in a variety of possible roles, all emphasizing enhancedsituational awareness, precision, and accuracy in the use of positionalinformation, as well as support for a higher tempo of operations withincreased confidence and reduced risk. Further, imagery-based terrainmodels, with terrain elevation data, can be generated from all datasources 108, 109, and 110 in selectable degrees of resolution. Combinedfor display, products can include terrain models, fixed and mobileobject models, weather or visibility effects, and map materials withmultiple “layers” of information.

[0078] GVP operating models are geo-specific, geo-referenced anduniversally scalable. In a preferred embodiment of the presentinvention, a geographical coordinate system enables accurate and rapidvisualization of an area via orienting position based on a geographicalcoordinate system to at least one eyepoint. The geographical coordinatesystem is fully compatible with standard navigation systems and permitsnavigation systems to connect, register, and synchronize with thesystem. In a more preferred embodiment of the present invention, aninternationally valid coordinate system is incorporated as thegeographical coordinate system. An applicable geographical coordinatesystem is the round-world WGS-84 standard that permits inputs from allmodem navigation systems to connect, register, and synchronizecorrectly. The WGS-84 is an approximation of the earth's surfacedefining a coordinate system, which provides a reference surface forGVP, and the geoid is the difference between the WGS-84 model and thetrue surface of the earth. Terrain model resolution is dependentprimarily on source imagery characteristics, but there are importantconsiderations with respect to demands for memory, i.e., dynamiccomputer texture memory, dynamic graphics memory, andapplication-specific demands for display update rate. GVP softwarearchitecture has been optimized to achieve very high update rates. TheGVP software can achieve update rate of between 50 and 60 frames persecond including in stereoscopic mode. Additionally, specific “highinterest” areas, as identified by a user, may be embedded in GVP modelsat a required high resolution.

[0079] The GVP software handles large complex models while maintaining ahigh update speed, i.e. above 50 frames per second. A typical set ofcultural features, such as buildings, can be added to GVP terrain modelswithout adverse impact on frame rate. Large numbers and many types ofmobile objects can be added with appearance, location, and dynamicsestablished by external sources 108, 109 and 110. The GVP architectureand model-handling processes enable relatively large numbers of suchscenarios to be modeled or displayed while maintaining high updaterates.

[0080] Terrain and any depicted features or modeled objects display atappropriate and controllable resolution levels or level of detail basedon primary object resolution, eyepoint distance and display 107 surfacecapability. The eyepoint(s) for viewing are entirely controllable alongwith all other relevant display 107 parameters.

[0081] Communication to the system is established and functional inseveral modes. Military elements and operational entities can beconnected via DII-COE messages in GCCS-M or other variants of the CombatCommand and Control System standards. All types of simulation can beconnected via HLA standards-compliant means and by DIS-formatted data103A. Other standard means such as the military LINK and air trafficcontrol radar data (not separately shown) are also accommodated.

[0082] By using a separate but integrated Master Object Manager module103 for collecting communication and control processes, thearchitecture:

[0083] streamlines CPU (not separately shown) resource allocation,

[0084] manages communication bandwidth,

[0085] structures upgrade efforts in the sense of tailoring the systemfor selected uses,

[0086] employs consistent application programmer interface (API)elements (not separately shown), and

[0087] assures reusability and scalability in GVP application tasksoftware 102.

[0088] The GVP CTL World display software 102 architecture is writtenfor, and adapts itself to, multi-processor CPUs, multi-channel videooutputs (not separately shown), and multi-pipe computer systems (notseparately shown), using all system resources.

[0089] The GVP CTL World software 102 that controls video output andcreates the visualization is government owned software and includesinterfaces to all software drivers (not separately shown) for input andoutput devices. Complete process and programming control affords freedomto optimize the system for specific applications and to capitalize onany available innovations. Interactive devices including mouse controls,joysticks, helmet-mounted head and eye trackers, voice control, gesturerecognition, etc. can be used without limitations imposed byinaccessible software source code.

[0090] All depictions in the basic GVP displays can be formatted asvideo products to be operated and displayed as perspective 2-D views of3-D models 107, scalable to various ranges and viewpoints. The GVP CTLWorld software 102 also supports binocular stereopsis for true 3-Ddisplays in several modes. CTL World 102 outputs active stereo, viewablewith shutter glasses for left and right eye view control. Dual opticsvirtual displays without shutters, i.e. virtual display devices, aredirectly supported including those for head directed, helmet mounted orhead mounted displays. CTL World software 102 also supports custom 3-Dvisualization products such as FAKESPACE VERSABENCH™ and other passivestereo displays which are generally viewed with polarized lenses forleft and right view control.

[0091] For all viewing modes and devices, CTL World software 102 has thenecessary control over video output to provide corrections andadjustments to match or trim for display device and viewing geometryrequirements. Explicit control of all stereo viewing parameters isincorporated in CTL World software 102 for full control of thestereoscopic viewing experience. Dynamic response to scaling changes ineyepoint is provided to maintain the intended stereoscopic effects.

[0092] In one embodiment, GVP supports investigation of humanengineering issues in advanced technology displays and informationvisualization. It provides effective and efficient software having anarchitecture tailored to interactive military systems. In another role,GVP can help speed development, while reducing costs of new systems, bycovering in simulation and testing various aspects of DoD missions.

[0093] Additionally, GVP may be implemented to reduce required memory tohold large area database files by incorporating fast file compressionand decompression. Further, GVP may be implemented to accept “streaming”information, i.e., “continuous” real time imagery or other data fromsensors, to update or replace database material, thus, providing timelyupdates for “real time” visualization.

EXAMPLES

[0094] Models suitable for flight simulator operation as out-the-windowdisplays. Because GVP is fully compliant with “round-world” geometrystandards, interfaces are facilitated in interactions between simulationmodels such as DIS that incorporate operational position data in thesimulation. The GVP model type and construction and the GVP CTL Worlddisplay software comprise a standard or uniform product type suitablefor “high end” military flight training simulators.

[0095] Unmanned Airborne Vehicle (UAV) and UCAV systems. GVP is suitablefor training, multi-platform command and control, reconnaissance andsurveillance processes, planning and rehearsal, and rapid prototypingapplications.

[0096] Interactive visualization during tactical flight operations.Applications range from mission rehearsal including while deployed orairborne to operational exploitation of near real time tacticalintelligence. GVP-based displays, by providing a full visualizationcontext for mission depiction, may also provide a natural means forground and aircrew to interact with and control advanced interactiveaircraft design features for pilot aiding devices and system automationfeatures.

[0097] The above descriptions should not be construed as limiting thescope of the invention but as mere illustrations of preferredembodiments. For example, although examples discussed at length militaryapplications, the method and apparatus is applicable to any that a usermay need to visualize in real time “relatively wide” areas within whichdynamic “relatively large” scale events occur. The scope shall bedetermined by appended claims as interpreted in light of the abovespecification.

What is claimed is:
 1. A process for dynamic human visualization ofevents occurring within a volume having varying spatial and temporalgradients, said process providing readily adjustable scale andresolution, and initiating activities internal thereto, comprising:acquiring data, wherein said data represents imagery, geometric and timerelationships to be used for generating motion paths, stored maps,location, and activity, and wherein said data is acquired from standardsources; integrating said data, wherein said integrating said data usesfull external network connectivity, wherein said data is acquired fromsimulations, actual events or standard sources, and wherein said dataincludes multi-source satellite and aerial imagery available in variouswavelengths and formats; developing at least one database, having asoftware architecture from which at least one model is generated;generating at least one display containing at least one depiction fromsaid at least one model and said data, wherein said depiction isdisplayed in real time; and controlling said at least one display. 2.The process of claim 1 further comprising enabling accurate and rapidvisualization of an area via orienting position based on a geographicalcoordinate system to at least one eyepoint, wherein, said geographicalcoordinate system is fully compatible with standard navigation systems,wherein included within said area are events having a range of spatialand temporal gradients, and wherein systems operating to saidgeographical coordinate system permit navigation systems to connect,register, and synchronize within said process.
 3. The process of claim 2further comprising enabling generation and control of at least onelarge-scale depiction on said at least one display while permitting useof said data, wherein said at least one depiction is provided in atwo-dimensional display, wherein said at least one depiction is providedin a fully stereoscopic display, wherein, said at least one display isadapted for use by at least one person as a virtual image display,wherein, terrain, depicted features or modeled objects display atresolution levels related to primary object resolution, said at leastone eyepoint distance, and display surface capability, and wherein, saidat least one eyepoint and said at least one display's parameters arecontrollable.
 4. The process of claim 3 wherein said at least onedisplay is adapted for use by more than one person as a theater display.5. The process of claim 1 further comprising: running said process on atleast one multiprocessor computer, having memory, upon which a portionof said data, is processed; incorporating fast file compression anddecompression, wherein said fast file compression and decompressionreduce requirements for said memory thus enabling development ofdatabase files representing large geographic areas; and wherein, saidprocess accepts streaming information to update or replace said data,providing timely updates for said depiction displayed in real time. 6.The process of claim 1 in which said at least one model is a terrainmodel, wherein said terrain model contains terrain imagery and geometrydata, wherein said at least one model retains the positional accuracyinherent in said data as originally acquired, wherein retention of thepositional accuracy enables an accurate depiction of an object'slocation and dynamic replay of events occurring within said volume,wherein said at least one model is geo-specific, geo-referenced, anduniversally scalable and provides an accurate depiction representativeof a round world, wherein, cultural features are added to said softwarearchitecture with negligible impact on response time of said process,wherein, types and instances of mobile objects are added havingappearance, location, and dynamics established by external sources, andwherein, said software architecture and said process enable multiplescenarios to be modeled or displayed while maintaining fast updaterates.
 7. The process of claim 6 further comprising employing databasesoftware to convert data files from said at least one model intodatabase products, wherein, said data files consist of a portion of saidterrain imagery and a portion of said geometry data contained in saidterrain model, wherein, said terrain imagery model combined with saidgeometry data incorporating terrain elevation is generated from morethan one source in at least one pre-selected degree of resolution,wherein, said database products are terrain models, fixed and mobileobject models, weather or visibility effects, or map materials withmultiple layers of information, wherein, cultural features are added tosaid software architecture with negligible impact on response time ofsaid process, wherein, many types and instances of mobile objects areadded, said instances having appearance, location, and dynamicsestablished by external sources, and wherein, said software architectureand said process enables multiple scenarios to be modeled or displayedwhile maintaining update rates that facilitate real time display.
 8. Theprocess of claim 1 further comprising: interfacing to outside events;defining objects and events to be displayed using said model; andproviding two-way communications with external events; wherein saidinterfacing is accomplished via a Master Object Manager module havingsoftware architecture, wherein said Master Object Manager collectscommunication and control processes, wherein said Master Object Managercan interact with standards-based processes selected from the groupconsisting of: distributed interactive simulation (DIS), DoD systemsunder High Level Architecture (HLA), Defense Information InfrastructureCommon Operating Environment (DII-COE) formats for the Global Commandand Control System (GCCS), and commercial computer networkcommunications protocols, wherein, said software architecture of saidMaster Object Manager achieves update rates facilitating real timeviewing on said display and permitting a user's areas of interest to beembedded at a pre-selected resolution, and wherein, said data is in aformat selected from the group consisting of: DII-COE messages inGCCS-M, Combat Command and Control System, HLA, DIS, military LINK, andair traffic control radar or any combination thereof.
 9. The process ofclaim 8 employing at least one specialized file structure in CTL Worldsoftware architecture, world geometry, and at least one specializedoperation to organize said data, wherein said world geometry is providedby CTL World software's display generation process, wherein, said CTLWorld software incorporates flexible user interface provisions, variousinput device drivers for position and motion control, and broadlyfunctional application programmer interface (API) features, and wherein,said CTL World display software is written for, and adapts itself to,multi-processor CPUs, multi-channel video outputs, and multi-pipecomputer systems.
 10. The process of claim 7 wherein said at least onedatabase is populated with clip texture files, said clip texture filesstored separately from said geometry files, wherein said separatestoring until run time of said clip texture files and said geometryfiles eliminates at least some computation prior to window contentselection for said at least one display.
 11. The process of claim 10wherein said geometry files are used to generate triangulated irregularnetwork (TIN) files, wherein said TIN files are polygons assembled toapproximate the surface shape of terrain.
 12. The process of claim 11wherein said clip texture files and said TIN files have an associateddata density that indicates the degree of precision in representingactual terrain, wherein said clip texture files and said geometry filesare retained and processed separately until combined immediately priorto said generating said at least one display.
 13. The process of claim10 further comprising applying dual quad tree architecture to said cliptexture files and said terrain geometry files, wherein management ofboth position and resolution variations within said clip texture filesand said terrain geometry files facilitates the population of at leastone worldwide database, wherein resolution of said display can beadjusted for varying eyepoints, a first adjustment possibly defining afirst level of a plurality of levels within said quad tree architecture,wherein each succeeding level of said plurality of levels may consist offour subsectors each depicting a quarter of the area of said depictionof an immediately preceding level but containing the same amount ofimage data as said depiction of the immediately preceding level, thusproviding higher resolution than any of said preceding levels, andwherein moving through said plurality of levels, in either direction,provides a resolution required by a user.
 14. The process of claim 13 inwhich said dual quad architecture is expandable, wherein said dual quadarchitecture consists of 32 levels that can hold and operate anywhere onthe earth's surface with a resolution of two centimeters.
 15. Theprocess of claim 9 wherein said Master Object Manager assembles andtracks locations, orientation, types, activities and depiction-relevantfactors for objects, wherein said Master Object Manager refines anobject list for said display by incorporating various sorting, filteringand aggregation algorithms, wherein some aspects of selection forvisibility and said display's level of detail required are conductedwithin said Master Object Manager to reduce computational demands insaid CTL World display generator, thereby conserving memory resourcesfor graphics processes while ordering data traffic between graphicsprocessing and external systems, and wherein said Master Object Managermay feed multiple copies of said CTL World to match various extendedvisualization generation demands.
 16. The process of claim 1 furthercomprising storing said motion paths as track history, wherein saidstoring includes said motion paths that are from external sources andsaid activities initiated internally thereto.
 17. The process of claim16 further comprising providing for replay of said events, wherein saidreplay combines external sources and said activities initiatedinternally thereto for replaying at least parts of said at least onedepiction on said at least one display.
 18. The process of claim 17 inwhich said track history and a GVP Replay Controller are used toreconstruct and manipulate said at least parts of said at least onedepiction.
 19. A system, having inputs, and outputs, that enables aprocess for dynamic human visualization of a volume, including eventshaving varying spatial and temporal gradients that are occurring withinthe volume, said system providing readily adjustable scale andresolution and initiating activities internal thereto, comprising: atleast one data generator as at least one source of data, wherein saiddata represents imagery, geometric and time relationships to be used forgenerating motion paths, stored maps, location, and activity, andwherein said data is acquired from standard sources; memory for storingand accessing at least a portion of said data; at least one interfacefor communication between said system and external devices; at least onevisualization device, having inputs and outputs, for displaying at leastone depiction, wherein said depiction may be derived at least in partfrom a model, having at least one input and at least one output, and isdisplayed in real time; at least one record and playback device forprovision of at least some inputs to said visualization device; softwarefor manipulating said process, wherein said software is used to generateat least one database, wherein said software is used at least in part tocreate said at least one model from said database, wherein, saidsoftware is used to control said inputs to and said outputs from said atleast one model for inputs to said at least one display, wherein, saidsoftware is used to control said outputs from said record and playbackdevice and said interface; and at least one controller for controllingsaid inputs and outputs to said system.
 20. The system of claim 19wherein said data generator comprises at least one device selected fromthe group consisting of: a real time data collection system, a GCCSsystem, a scenario generator, a device simulator, and a cockpitsimulator.
 21. The system of claim 19 wherein said memory is providedwithin at least one computer, wherein said computer incorporatesmultiprocessors.
 22. The system of claim 19 wherein said at least oneinterface for communication between said system and external devices isa Master Object Manager, comprising at least one software module and atleast one hardware connection sufficient to interface said system to atleast one source external to said system.
 23. The system of claim 19wherein said visualization device is selected from the group consistingof: a CRT or flat-panel display, a single user display for unobtrusivewear upon the human body, a large scale projector with screen, ahelmet-mounted display, a display built in to wearable optics, avolumetric display, a vehicle-mounted display, shutter glasses for leftand right eye view control, a cockpit-mounted display, a heads-updisplay, a device that supports binocular stereopsis for true 3-D, anddual optics virtual displays.
 24. The system of claim 19 wherein said atleast one record and playback device is a global visualization processplayback controller.
 25. The system of claim 19 wherein said softwarefor manipulating said process comprises at least a CTL World softwaremodule, wherein, said CTL World software module outputs active stereo,and wherein, said CTL World software module supports binocularstereopsis for true 3-D displays as well as helmet, head-mounted, andcustom 3-D visualization products.
 26. The system of claim 25 whereinsaid at least one controller for controlling said inputs and outputs tosaid system incorporates hardware devices that interface using said CTLWorld software, said hardware devices selected from the group consistingof: a mouse, a trackball, a pointer, a joystick, a keyboard, amicrophone, a device employing a capacitive sensor, and a touch screen.